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1. Introduction 

Game theory has long been commonly used in economics, the social sciences and 
biology to model decision making situations where the outcomes are contingent upon the 
interacting strategies of two or more agents with conflicting, or at best, self-interested 
motives. There is now increasing interest in applying game-theoretic techniques in 
physics [1J. With the enthusiasm for quantum computation there has been a surge 
of interest in the discipline of quantum information [2] that has lead to the creation 
of a new field combining game theory and quantum mechanics: quantum game 
theory [Hj. By replacing classical probabilities with quantum amplitudes and allowing 
the players to employ superposition, entanglement and interference, quantum game 
theory produces new ideas from classical two-player |U 13 El El and multi-player 
settings [HI HH H21 US] . Quantum prisoners' dilemma has been realized on a two qubit 
nuclear magnetic resonance machine Jl] . A review of quantum games is given by Flitney 
and Abbott TT7T1 . 

Decoherence can be defined as non-unitary dynamics resulting from the coupling 
of the system with the environment. In any realistic quantum computer, interaction 
with the environment cannot be entirely eliminated. Such interaction can destroy the 
special features of quantum computation. A recent review of the standard mechanisms 
of quantum decoherence can be found in reference [IB] . Quantum computing in the 
presence of noise is possible with the use of quantum error correction ^7] or decoherence 
free subspaces ^B]- These techniques work by encoding the logical qubits in a number 
of physical qubits. Quantum error correction is successful, provided the error rate is low 
enough, while decoherence free subspaces control certain types of decoherence. Both 
have the disadvantage of expanding the number of qubits required for a calculation. 
Without such measures, the theory of quantum control in the presence of noise and 
decoherence is little studied. This motivates the study of quantum games, which can be 
viewed as a game-theoretic approach to quantum control — game-theoretic methods in 
classical control theory ^Hj are well-established and translating them to the quantum 
realm is a promising area of study. Johnson has considered a quantum game corrupted 
by noisy input [20] • Above a certain level of noise it was found that the quantum effects 
impede the players to such a degree that they were better off playing the classical game. 
Chen et al have discussed decoherence in quantum prisoners' dilemma [21] . Decoherence 
was found to have no effect on the Nash equilibrium in this model. The current work 
considers general quantum games in the presence of decoherence. The paper is organized 
as follows. Section [2] outlines our model for introducing decoherence into quantum 
games, section El presents some specific results from this model for two-player, two- 
strategy quantum games, section Ogives an example of decoherence in another quantum 
game and section El presents concluding remarks. 
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2. Quantum games with decoherence 

The process of quantizing a game with two pure strategies proceeds as follows. In the 
classical game the possible actions of a player can be encoded by a bit. This is replaced 
by a qubit in the quantum case. The computational basis states |0) and |1) represent 
the classical pure strategies, with the players' qubits initially prepared in the |0) state. 
The players' moves are unitary operators, or more generally, completely positive, trace- 
preserving maps, drawn from a set of strategies 5*, acting on their qubits. Interaction 
between the players' qubits is necessary for the quantum game to give something new. 
Eisert et al produced interesting new features by introducing entanglement [I]. The 
final state of an iV-player quantum game in this model is computed by 

= P{M x ®M 2 ®...®M N )J\ijj ) , (1) 

where \ipo) = |00 . . . 0) represents the initial state of the N qubits, J (Jt) is an operator 
that entangles (dis-entangles) the players' qubits, and M k , k = 1, . . . , N, represents the 
move of player k. A measurement over the computational basis is taken on \ipf) and 
the payoffs are subsequently determined using the payoff matrix of the classical game. 
The two classical pure strategies are the identity and the bit flip operator. The classical 
game is made a subset of the quantum one by requiring that J commute with the direct 
product of iV classical moves. Games with more than two classical pure strategies are 
catered for by replacing the qubits by qunits (n level quantum systems) or, equivalently, 
by associating with each player a number of qubits. For a discussion of the formalism 
of quantum games see [2*2*] . 

It is most convenient to use the density matrix notation for the state of the system 
and the operator sum representation for the quantum operators. Decoherence can take 
many forms including dephasing, which randomizes the relative phases of the quantum 
states, and dissipation that modifies the populations of the quantum states. Pure 
dephasing of a qubit can be expressed as 

o|0) + 6|1) -> a|0) + fee^l). (2) 

If we assume that the phase kick is a random variable with a Gaussian distribution 
of mean zero and variance 2A, then the density matrix obtained after averaging over all 
values of <fi is [2 J 

a\ 2 ab \ I \a\ 2 abe~ 
ah \b\ 2 J 1 abe- x \b\ 2 

Over time, the random phase kicks cause an exponential decay of the off-diagonal 
elements of the density matrix. 

In this work we shall use the quantum operator formalism to model decoherence. 
This method is well known to have its limitations j2Hj- For a good description of the 
quantum operator formalism and an example of its limitations the reader is referred 
to chapter 8 of reference Other methods for calculating decoherence include using 
Lagrangian field theory, path integrals, master equations, quantum Langevin equations, 
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short-time perturbation expansions, Monte-Carlo methods, semiclassical methods, and 
phenomenological methods |24j . 

In the operator sum representation, the act of making a measurement with 
probability p in the {|0), |1)} basis on a qubit p is 

2 

j=0 



where So = v /p|0)(0|, E\ = y/p\l)(l\ and S 2 = y/1 — pi. An extension to iV qubits is 
achieved by applying the measurement to each qubit in turn, resulting in 

2 

i> - Yl %®---®<w4 v ®---®4> ( 5 ) 

3i,—Jn=0 

where p is the density matrix of the N qubit system. This process also leads to the 
decay of the off-diagonal elements of p. By identifying 1 — p — e~ x , the measurement 
process has the same results as pure dephasing. 

Independently of the particular model used, a quantum game with decoherence can 
be described in the following manner 

Pi = p Q = \ipo)(i J o\ (initial state) 

Pi = J po-P (entanglement) 
p 2 = D(pi,px) (partial decoherence) 

P3 = (®f =1 Mfc)p 2 (®^ = iMfc) t (players' moves) 
Pi = D(p 3 ,p 2 ) (partial decoherence) 

Ps = P p^J (dis-entanglement), (6) 

to produce the final state p/ = ps upon which a measurement is taken. The function 
D(p,p) is a completely positive map that applies some form of decoherence to the state 
p controlled by the probability p. The scheme is shown in figure The expectation 
value of the payoff for the kth player is 

a 

where P a = \a)(a\ is the projector onto the state \a), $^ is the payoff to the kth player 
when the final state is \a), and the summation is taken over a = jij 2 ■ ■ ■ ]n, ji = 0, 1. 

3. Results for 2x2 quantum games 

Let S = {U (9, a, /3) : < 9 < ir, — n < a, (3 < 7r} be the set of pure quantum strategies, 
where 



TK9 rv m- I eiacos (^/ 2 ) ie i/3 sin(^/2) . 

U(9,a,(3)-[ ie ^ si<e/2) e -ia cosm I (8) 



Quantum games with decoherence 



Pi 

10} 

® 
10} 



10} 

P2 



J 



D 



i i i i 
i i i i 
i i i i 



time 



^^^^ 



Mi 



Mo 



M 



N 



D 



I I I I 
I I I I 
I I I I 



IV>/> 



V 



Figure 1. The flow of information in an iV-person quantum game with decoherence, 
where is the move of the fcth player and J (JT) is an entangling (dis-entangling) 
gate. The central horizontal lines are the players' qubits and the top and bottom lines 
are classical random bits with a probability pi or p2, respectively, of being 1. Here, D 
is some form of decoherence controlled by the classical bits. 



is an SU(2) operator. The move of the fcth player is U(9k,ak, Pk)- The classical moves 
are I = U(0, 0, 0) and F = U(ir, 0, 0). Entanglement is achieved by [H] 

j = + io*»). (9) 

Operators from the set S c \ = {U(9, 0,0): < 9 < n} are equivalent to classical mixed 
strategies since, when all players use these strategies, the quantum game reduces to the 
classical one. There is some arbitrariness about the representation of the operators. 
Different representations will only lead to a different overall phase in the final state and 
this has no physical significance. 

After choosing equation (jSJ to represent the function D in @, we are now in a 
position to write down the results of decoherence in a 2 x 2 quantum game. Using the 
subscripts A and B to indicate the parameters of the two traditional protagonists Alice 
and Bob, respectively, and writing c& = cos(^/2) and s& = sin(^/2) for k = a,b, the 
expectation value of a player's payoff is 

($) = ^(44 + 44)($oo + $n) + \{c\sl + 44)(V + $io) 

+ ^(l-p 1 ) 2 (l-p 2 ) 2 {[44cos(2a A + 2a B ) - 44 cos(2/3 A + 2/5 B )]($ 00 - 

+ [44 cos (2aA - 2/3 B ) - 44 cos (2«b - 2/3 A )]($oi - $io)} 

+-sin6'Asin6'B [(1 -pi) 2 sin(a A + a B - Pa - /3b)(-$oo + $oi + $io - $11) 

+ (1 - p 2 ) 2 sin(a A + «b + Pa + Pb)($oo ~ $n) 
+ (1 - p 2 ) 2 sin(a A - «b + Pa ~ Pb)($io ~ $oi)] , 

where $jj is the payoff to the player for the final state \ij). Setting p 1 = p 2 = gives 
the quantum games of the Eisert et al model jl] studied in the literature. If in addition, 
ttfc — Pk — 0, k — a,b, a 2 x 2 classical game results with the mixing between the two 
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classical pure strategies I and F being determined by 9a and 9b for Alice and Bob, 
respectively. Maximum decoherence with p\ — p 2 — 1 gives a result where the quantum 
phases and /?* are not relevant: 

($) = f ($00 + $ll) + ^($01 + $io), (11) 

where x = (? a c b + s A s B . In a symmetric game the payoff to both players is the same 
and the game is not equivalent to the original classical game. Extrema for the payoffs 
occur when both #'s are or 7r. 

One way of measuring the "quantum-ness" of the game is to consider the known 
advantage of a player having access to the full set of quantum strategies S over a player 
who is limited to the classical set S c \ JHI2S]. If we restrict Alice to a a = Pa = 0, then, 

($) = 2 ($oo + $11 ) + — - — ($oi + $io) 

- Pl f{\ - p 2 f {4 cos2a B [4($ 00 - $11) + 4($io - $oi)] 
-4 cos2/? B [4($io - $oi) + 4($oo - $11)]} 
+^sin0 A sin0 B [(1 - Pi) 2 sin(a B - /3 B )(-$oo + $oi + $io - $n) 

+ (l-p 2 ) 2 sin(aB + /5 B )($oo + $oi-$io-$ii)] ■ (12) 
For prisoners' dilemma, the standard payoff matrix is 



prisoners' 


Bob : 




dilemma 


cooperation(C) 


defection(D) 


Alice : C 


(3,3) 


(0,5) 


D 


(5,0) 


(1,1) 



(13) 



where the numbers in parentheses represent payoffs to Alice and Bob, respectively. The 
classical pure strategies are cooperation (C) and defection (D). Defecting gives a better 
payoff regardless of the other player's strategy, so it is a dominant strategy, and mutual 
defection is the Nash equilibrium. The well known dilemma arises from the fact that 
both players would be better off with mutual cooperation, if this could be engineered. 
With the payoffs of equation (fT3^1. the best Bob can do from equation (fT^ is to select 
qb = 7r/2 and /3b = 0. Bob's choice of 6b will depend on Alice's choice of 6a- He can do 
no better than 9b = tt/2 if he is ignorant of Alice's strategy^. Figure 121 shows Alice and 
Bob's payoffs as a function of decoherence probability p = pi = p 2 and Alice's strategy 
9 = 9a when Bob selects this optimal strategy. 

The standard payoff matrix for the game of chicken is 





Bob : 




chicken 


cooperation(C) 


defection(D) 


Alice : C 


(3,3) 


(1,4) 


D 


(4,1) 


(0,0) 



(14) 



| See Flitney and Abbott for details of quantum versus classical players. 
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Figure 2. Payoffs for (a) Alice and (b) Bob in quantum prisoners' dilemma as a 
function of decoherence probability p and Alice's strategy 9 (being a measure of the 
mixing between cooperation (C) and defection (D) with 9 = giving C and 9 = tt 
giving D) , when Bob plays the optimum quantum strategy and Alice is restricted to 
classical strategies. The decoherence goes from the unperturbed quantum game at 
p = to maximum decoherence at p = 1 . 



There is no dominant strategy. Both CD and DC are Nash equilibria, with the former 
preferred by Bob and the latter by Alice. Again there is a dilemma since the Pareto 
optimal results CC is different from both Nash equilibria. As above, Bob's payoff is 
optimized by an = n/2, j3 B = and 9b = tt/2. Figure El shows the payoffs as a function 
of decoherence probability p and Alice's strategy 9. 

One form of the payoff matrix for the battle of the sexes is 



battle 


Bob : 




of the sexes 


opera(O) 


television (T) 


Alice : 


(2,1) 


(0,0) 


T 


(0,0) 


(1,2) 



(15) 



Here the two protagonist must decide on an evening's entertainment. Alice prefers 
opera (O) and Bob television (T), but their primary concern is that they do an activity 
together. In the absence of communication there is a coordination problem. A quantum 
Bob maximizes his payoff in a competition with a classical Alice by choosing cub = — 7r/2, 
Pb = and 9b = tt/2. Figure |U shows the resulting payoffs for Alice and Bob as a 
function of decoherence probability p and Alice's strategy 9. 

The optimal strategy for Alice in the three games considered is 9 = n (or 0) for 
prisoners' dilemma, or 9 = n/2 for chicken and battle of the sexes. Figure El shows 
the expectation value of the payoffs to Alice and Bob as a function of the decoherence 
probability p for each of the games when Alice chooses her optimal classical strategy. 
In all cases considered, Bob outscores Alice and performs better than his classical 
Nash equilibrium result provided p < l.§ The advantage of having access to quantum 
strategies decreases as p increases, being minimal above p ~ 0.5, but is still present 

§ or the poorer of his two Nash equilibria in the case of chicken or the battle of the sexes 
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Figure 3. Payoffs for (a) Alice and (b) Bob in quantum chicken as a function 
of decoherence probability p and Alice's strategy 0, when Bob plays the optimum 
quantum strategy and Alice is restricted to a classical mixed strategy. 




Figure 4. Payoffs for (a) Alice and (b) Bob in quantum battle of the sexes as a function 
of decoherence probability p and Alice's strategy 6, when Bob plays the optimum 
quantum strategy and Alice is restricted to a classical mixed strategy. 



for all levels of decoherence up to the maximum. At maximum decoherence (p = 1), 
with the selected strategies, the game result is randomized and the expectation of the 
payoffs are simply the average over the four possible results. The results presented in 
figures |2l El and |U are comparable to the results for different levels of entanglement [23] . 
They are also consistent with the results of Chen and co-workers [21] who show that 
with increasing decoherence the payoffs to both players approach the average of the four 
payoffs in a quantum prisoners' dilemma. 

4. Decoherence in other quantum games 

A simple effect of decoherence can be seen in Meyer's quantum penny-flip [3| between P, 
who is restricted to classical strategies, and Q, who has access to quantum operations. 
In the classical game, P places a coin heads up in a box. First Q, then P, then Q again, 
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Figure 5. Payoffs as a function of decoherence probability p, going from fully 
decohered on the left (p = 1) to fully coherent on the right (p = 0), for (a) Alice and 
(b) Bob for the quantum games prisoners' dilemma (PD), chicken (Ch) and battle of 
the sexes (BoS). Bob plays the optimum quantum strategy and Alice her best classical 
counter strategy. As expected, the payoff to the quantum player, Bob, increases with 
increasing coherence while Alice performs worse except in the case of battle of the 
sexes. This game is a coordination game — both players do better if they select the 
same move — and Bob can increasingly engineer coordination as coherence improves, 
helping Alice as well as himself. 

have the option of (secretly) flipping the coin or leaving it unaltered, after which the 
state of the coin is revealed. If the coin shows heads, Q is victorious. Since the players' 
moves are carried out in secret they do not know the intermediate states of the coin and 
hence the classical game is balanced. 

In the quantum version, the coin is replaced by a qubit prepared in the |0) 
("heads") state. Having access to quantum operations, Q applies the Hadamard 
operator to produce the superposition (|0) + |l))/\/2. This state is invariant under 
the transformation |0) <-> |1) so P's action has no effect. On his second move Q again 
applies the Hadamard operator to return the qubit to |0). Thus Q wins with certainty 
against any classical strategy by P. 

Decoherence can be added to this model by applying a measurement with 
probability p after Q's first move. Applying the same operation after P's move has 
the same effect since his move is either the identity or a bit-flip. If the initial state of 
the coin is represented by the density matrix p = |0)(0|, the final state can be calculated 
by 

1 / 4 - 2p \ (16) 
~ 4 ^ 2p J ' 

where H is the Hadamard operator, P is P's move (I or a x ), and D = ^/l — pi + 
v /p(|0)(0| + |1)(1|) is a measurement in the computational basis with probability p. 
Again, the final state is independent of P's move. The expectation of Q winning 
decreases linearly from one to \ as p goes from zero to one. Maximum decoherence 
produces a fair game. 
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As an example of the effect of decoherence on another quantum game consider a 
game analogous to a three player duel, or truel, between Alice, Bob and Charles [T3j . 
The classical version can be described as follows. Each player has a bit, starting in 
the one state. The players move in sequence in alphabetic order. A move consists of 
either doing nothing or attempting to flip an opponent's bit with a known probability 
of failure of a, b or c, for Alice, Bob and Charles, respectively. A player can do nothing 
if their bit is zero. The payoffs at the completion of the game are l/(number of bits 
in the one state) to a player whose bit is one, or zero otherwise. (The connection with 
a truel is made by considering one to correspond to "alive" and zero to "dead". A 
move is an attempt to shoot an opponent.) In some situation the optimal strategy is 
counter-intuitive. It may be beneficial for a player to do nothing rather than attempt 
to flip an opponent's bit from one to zero, since if they are successful they become the 
target for the third player. 

The game is quantized by replacing the players' bits by qubits and by replacing the 
flip operation by an SU(2) operator of the form of equation (jHJ operating on the chosen 
qubit. Maintaining coherence throughout the game removes the dynamic aspect since 
the players can get no information on the success of previous moves. Noise can be added 
to the quantum game by giving a probability p of a measurement being made after each 
move, and in the case of a measurement, allowing the players to choose their strategy 
depending on the result of previous rounds, which are now known. Figure |B1 shows the 
regions of the parameter space (a, b) corresponding to Alice's preferred strategy in a one 
round truel when c = (i.e., when Charles is always successful). The boundary between 
Alice maximizing her expected payoff by doing nothing and by targeting Charles depends 
on the decoherence probability p. We see a smooth transition from the quantum case to 
the classical as p goes from zero to one. Note that the boundary in the parameter space 
changes from linear in the classical case to convex in the quantum case. This is of interest 
since convexity is being intensely studied as the basis for Parrondo's paradox j2Ell2Z| and 
the current example may provide an opportunity for generating a quantum Parrondo's 
paradox [2H1 HE EH] • 

5. Conclusion 

A method of introducing decoherence into quantum games has been presented. One 
measure of the "quantum-ness" of a quantum game subject to decoherence is the 
advantage a quantum player has over a player restricted to classical strategies. As 
expected, increasing the amount of decoherence degrades the advantage of the quantum 
player. However, in the model considered, this advantage does not entirely disappear 
until the decoherence is a maximum. When this occurs in a 2 x 2 symmetric game, 
the results of the players are equal. The classical game is not reproduced. The loss of 
advantage to the quantum player is very similar to that which occurs when the level of 
entanglement between the players' qubits is reduced. 

In the example of a one-round quantum truel, increasing the level of decoherence 
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Figure 6. In a one round quantum truel with c = and with decoherence, the 
boundaries for different values of the decoherence probability p below which Alice 
maximizes her expected payoff by doing nothing and above which by targeting Charles. 
There is a smooth transition from the fully quantum case (p = 0) to the classical one 
(p = 1). From Flitncy and Abbott [T3|. 

altered the regions of parameter space corresponding to different preferred strategies 
smoothly toward the classical regions. In this quantum game, maximum decoherence 
produces a situation identical to the classical game. 

In multi-player quantum games it is known that new Nash equilibria can arise jl()j . 
The effect of decoherence on the existence of the new equilibria is an interesting open 
question. There has been some work on continuous-variable quantum games 
involving an infinite dimensional Hilbert space. The study of decoherence in infinite 
dimensional Hilbert space quantum games would need to go beyond the simple quantum 
operator method presented in this paper and is yet to be considered. 

This paper has focused on static quantum games and so future work on game- 
theoretic methods for dynamic quantum systems with different types of decohering noise 
will be of great interest. A particular open question will be to compare the behavior 
of such quantum games for (a) the non-Markovian case, where the quantum system is 
coupled to a dissipative environment with memory, with (b) the Markovian (memoryless) 
limit where the correlation times, in the decohering environment, are small compared 
to the characteristic time scale of the quantum system. 
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